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Abstract: We primarily study a possible link between 2021 COVID-19 vaccination uptake in Europe 
and monthly 2022 excess all-cause mortality, i.e., mortality higher than before the pandemic. Anal- 
yses of 31 countries weighted by population size show that all-cause mortality during the first nine 
months of 2022 increased more the higher the 2021 vaccination uptake; a one percentage point in- 
crease in 2021 vaccination uptake was associated with a monthly mortality increase in 2022 by 0.105 
percent (95% CI, 0.075-0.134). When controlling for alternative explanations, the association re- 
mained robust, and we discuss the result emphasizing causality as well as potential ecological fal- 
lacy. Also, the study shows that 2021 all-cause mortality was lower the higher the vaccination up- 
take, but this association became non-significant when controlling for alternative explanations. 
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1. Introduction 


According to Eurostat, the EU experienced excess all-cause mortality in the first nine 
months of 2022, i.e., the mortality was higher than the average of the same months be- 
tween 2016 and 2019, before COVID-19 (1). In this study, our primary aim is to investigate 
if the pattern — 2022 nation-level monthly all-cause mortality relative to pre-pandemic 
numbers — can be linked to nation-level COVID-19 vaccination uptake by the end of the 
previous year, 2021. 

Although research has indicated that COVID-19 vaccination has prevented SARS- 
CoV-2-related hospital admission and deaths (2-4) , its preventive effect has waned (5). 
Also, COVID-19 vaccination has side effects (6-9), such as myocarditis and pericarditis 
(10, 11), and along with this knowledge, it is worth noting that a recent study falsified a 
suspected association between the two diagnoses and COVID-19 virus infection (12). 
Coining this information with research showing that vaccine side effects generally tend to 
be underreported (13), we ask if COVID-19 vaccination may be associated with long-term 
mortality. To study this potential link, we regress all-cause mortality in the first nine 
months of 2022 (relative to pre-pandemic levels) on vaccination uptake in 31 European 
countries by the end of 2021. The 31 countries are the EU member states, plus Norway, 
Iceland, Liechtenstein, and Switzerland. The estimates are weighted by each country’s 
population size by January 1, 2020. Also, we include an interaction term between vaccina- 
tion uptake and the time that has passed since the beginning of 2022. Our motive is to 
assess if a potential link between vaccination uptake and all-cause mortality has changed 
over time. (To further illuminate the study’s topic, the Appendix illustrates the association 
between 2021 vaccination uptake and all-cause mortality the same year relative to pre- 
pandemic levels.) 

In the following, we present the materials and methods in detail and report the em- 
pirical results. Then, we discuss the findings, address the study’s limitations, and suggest 
avenues for future research. When discussing the results and addressing study limita- 
tions, we particularly emphasize the issues of causal inference and ecological fallacy. 


2. Materials and Methods 


As a dependent variable, we applied data from Eurostat, which models the countries’ 
all-cause mortality each month divided by the average of the same month between 2016 
and 2019 multiplied by 100 (1). Finally, the expression is subtracted by 100, which implies 
that positive values indicate excess mortality and negative values indicate sub-mortality. 
Vaccination uptake is the percentage of the total population in each country that has re- 
ceived a “primary course” by week 52, 2021. We gathered the data from the COVID-19 
vaccine tracker by the European Centre for Disease Prevention and Control (14), except 
for Switzerland, where we used Our World in Data as a source (15) (for details on coun- 
tries’ vaccination uptake and size in population, please see Table 1). Each month in 2022 
is modeled straightforwardly, where January takes the value of one, February two, etc. 

We control for pre-COVID life expectancy in 2019 using Eurostat data (16) as it is a 
proxy for health status in each country (17). Lastly, we control for average all-cause mor- 
tality in 2020 and 2021 divided by the average between 2016 and 2019 (18). Our motive for 
the control variable is that relatively high mortality in 2020 and 2021 may induce relatively 
low mortality in 2022 and vice versa. On the other hand, relatively high mortality in 2020 
and 2021 may indicate a deteriorating health status not captured by pre-COVID life ex- 
pectancy. For consistency, we multiply the measure by 100. 

Below, we first present descriptive statistics and correlations. Next, in our statistical 
models, we apply linear multilevel mixed-effects random intercept regression analyses 
where monthly observations are nested at the country level (for details, please see, e.g., 
19, 20). As noted, observations are weighted according to the population size by January 
1, 2020, and we carry out all analyses in Stata 17.0 (21). 


Table 1. Vaccination uptake and countries’ population size. 


Country Vaccination uptake Population 
Bulgaria 27.7 6951482 
Romania 40.8 19328838 
Slovakia 48.5 5457873 

Croatia 53.3 4058165 
Slovenia 55.6 2095861 

Poland 55.8 37958138 
Hungary 61.0 9769526 

Estonia 61.3 1328976 
Czechia 62.2 10693939 

Latvia 64.9 1907675 
Liechtenstein 65.4 38747 
Lithuania 65.7 2794090 
Greece 66.3 10718565 
Switzerland 67.1 8606033 
Netherlands 67.6 17407585 
Luxembourg 68.2 626108 

Sweden 69.3 10327589 

Cyprus 69.4 888005 

Austria 70.4 8901064 
Germany 72.8 83166711 
Norway 73.0 5367580 

France 73.3 67320216 

Italy 74.9 59641488 
Spain 74.9 47332614 

Finland 75.0 5525292 
Belgium 76.2 11522440 

Iceland 76.4 364134 


Ireland 76.6 4964440 


Denmark 78.7 5822763 
Malta 82.1 514564 
Portugal 83.1 10295909 


Table 2. Descriptive statistics and correlations weighted by countries’ population size. 


Min. Max. Mean St. dev. 1 2 3 4 
254 53.9 9.98 724 Month. 2022 n to 2016-19 avg. 
Avg. 2020-2021 mort. rel. to 2016- 
101.4 1261 1125 5.58 DE 0.016 
75.1 84.3 81.5 2.47 Life expectancy in 2019 (3) 0.113+ -0.620*** 
1 9 5 2.59 Month number in 2022 (4) 0.256*** 0 0 
27.7 83.1 68.7 10.3 Meealon a by the end of 0.071 -0.742*** 0.857* 0 


Two-tailed tests of significance. t p < 0.10; * p < 0.05; ** p < 0.01; *** p < 0.001. N=248. 


3. Results 


Table 2 reports minimum values, maximum values, descriptive statistics, and corre- 
lations. We observe strong correlations between vaccination uptake and the control vari- 
ables average 2020-2021 mortality and life expectancy, which may cause problems with 
multicollinearity (for an informative discussion, please see e.g., 22). Later, we explain how 
we deal with the issue. 

Model 1, Table 3, shows that vaccination uptake has a non-significant direct associa- 
tion with the dependent variable, but the significant monthly association indicates that 
the overall mortality tends to increase over time. The interaction between vaccination up- 
take and time passed in months since the beginning of 2022 (V*M) is strongly significant 
and implies that the mortality increases the higher the vaccination uptake. Specifically, it 
shows that a one percentage point increase in 2021 vaccination uptake is associated with 
an increase in 2022 monthly mortality by 0.105 percent (95% CI, 0.075-0.134). 

We mean-center the variables to minimize potential multicollinearity problems [cf. 
23], and the variance inflation factor (VIF) taking a value of one concerning the month 
variable and the interaction term shows that multicollinearity is not a problem. However, 
the VIF concerning the vaccination uptake taking a value of 5.17, may be problematic. To 
amend the issue, we omit the control variables in Model 2 and observe that all the VIFs 
are now low. Also, the remaining estimates and their error terms are not much altered. 

As robustness checks, in Models 3 and 4, we add an interaction term between each 
control variable and the month variable at a time. We observe that statistical conclusions 
concerning the independent variables and their interaction term are unaltered. The only 
exception is vaccination uptake showing a borderline significant association with the de- 
pendent variable in Model 3. Model 5 replicates the first model except that it excluded 
July when a heat wave occurred. The overall increasing monthly association is now bor- 
derline significant, but the interaction term association remains robust. Finally, we carried 
out unreported analyses controlling for 2018 nation-level median age and 2019 per-capita 
GDP adjusted for purchasing power, respectively, as done in Models 3 and 4, but without 
altering any statistical conclusion (analyses are available upon request). 


Table 3. Multi-level mixed-effects random intercept linear regressions with robust standard errors 
and 2022 monthly all-cause mortality compared to 2016-19 monthly averages as the dependent var- 
iable. Weighted by countries’ population size. 


Model 1 Model 2 Model 3 Model 4 Model 54 
FIXED EFFECTS 
Intercept 9.98"** 9.98"** 9.98*** 9.98"** 9.21*** 
(0.439) (0.481) (0.423) (0.463) (0.470) 
Vaccination uptake by the end of 2021 (V) 0.016 0.050 0.130t -0.066 0.004 
(0.105) (0.048) (0.067) (0.077) (0.105) 
[5.17] [1.00] [2.23] [2.76] [5.18] 
Month number in 2022 (M) 0.716** 0.716** 0.716** 0.716** 0.484+ 
(0.262) (0.262) (0.249) (0.258) (0.280) 
[1.00] [1.00] [1.00] [1.00] [1.00] 
Avg. 2020-2021 mort. rel. to 2016-2019 (A) 0.190 0.198t 0.105 
(0.137) (0.117) (0.146) 
[2.23] [2.23] [2.23] 
Life expectancy 2019 (L) 0.538+ 0.565 0.210 
(0.318) (0.346) (0.333) 
[3.77] [3.76] [3.77] 
V*M 0.105*** 0.105*** 0.090*** 0.111** 0.091*** 
(0.015) (0.015) (0.022) (0.032) (0.015) 
[1.00] [1.00] [2.23] [3.76] [1.01] 
A*M -0.037 
(0.048) 
[2.23] 
L*M -0.031 
(0.151) 
[3.76] 
RANDOM EFFECTS 
Residual 38.3 38.3 38.1 38.3 28.5 
(7.88) (7.88) (8.08) (7.96) (5.62) 
Country effect 1.52 2.53 2.00 2.02 2.39 
(2.43) (2.65) (2.59) (2.64) (2.31) 
Wald y2 128.2*** 134.0*** 191.1*** 179.5*** 109.0*** 
Log pseudo-likelihood -1.35e10 -1.36e10 -1.36e10 -1.36e10 -1.16e10 


Estimates are weighted by country size in population size by January 1, 2020, and we report robust standard errors in parentheses. 
We report variance inflation factors (VIFs) in brackets. For fixed effects, we report conservative two-tailed tests of significance. t p < 
0.10; * p < 0.05; ** p < 0.01; *** p< 0.001. Models 1-4 have 279 monthly observations (nine monthly observations per each of the 31 
countries). *Model 5 excludes July 2022 and has 248 monthly observations (eight observations per each of the 31 countries). 


Figure 1A-C, based on Model 1, Table 3, concludes the findings. It indicates increas- 
ing all-cause excess mortality (Figure 1A), and more strikingly, the increase is higher the 
higher the national vaccination uptake (Figure 1B). As noted, a one percentage point in- 
crease in 2021 vaccination uptake is associated with an increase in 2022 monthly mortality 
by 0.105 percent (95% CI, 0.075-0.134). In countries with relatively high vaccination up- 
takes, which include numerous of Europe’s states and the most populous (Figure 1D, 
based on Table 1), the result estimates a mortality increase (Figure 1C). In countries with 
relatively low vaccination uptakes, the result estimates a low or even negative mortality 


increase (Figure 1C). 
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Figure 1. Monthly estimated excess mortality (A) and estimated change in excess mortality as a 
function of national vaccination uptake with 95% Cis (B). Estimated excess mortality for vaccination 
uptake at 60% (blue), 75% (green), 68.7% (red), which is the weighted European average, and actual 
excess mortality (yellow) (C). Vaccination uptake and population size (D). A-C are based on Model 
1, Table 3, and D is based on Table 1. 


4. Discussion 


This study shows that the all-cause mortality during the first nine months of 2022 in 
31 European countries increased more the higher the 2021 vaccination uptake. The asso- 
ciation is strongly significant (Table 3), but to make causal inferences, it is further neces- 
sary to (1) rule out reverse causality and (2) account for alternative explanations (cf. John 
Stuart Mill cited in Cook and Campbell, 23, pp. 18-20). Below we discuss both issues. Also, 
we discuss our study in light of potential (3) ecological fallacy, which is a “failure in rea- 
soning that arises when an inference is made about an individual based on aggregate data 
for a group” (24). 

Concerning potential reverse causality (1), the timing of the independent and de- 
pendent variables is crucial. Relating the timing condition to our study, we find it unrea- 
sonable, actually logically impossible, that increasing monthly all-cause mortality in 2022 
could have occurred before and hence caused vaccination uptake in the previous year, 
2021. Accordingly, ceteris paribus it is more likely to assume that 2021 vaccination uptake 
will have caused monthly increases in 2022 mortality than the other way around. 

Concerning alternative explanations (2), we controlled for average all-cause mortal- 
ity in 2020 and 2021 divided by the average between 2016 and 2019. The all-cause mortal- 
ity during 2020 and 2021 was relatively low in countries with relatively high vaccination 
uptakes (Table 2), and had we not controlled for this issue, one could alternatively have 
argued for a so-called “bounce-back effect,” i.e., relatively low mortality at one period is 
followed by relatively high mortality later, and vice versa. E.g., the relatively high mor- 
tality in the first months of 2022 could have been due to relatively low mortality in the 


previous two years, but, as mentioned, we controlled for this issue. Moreover, we not only 
controlled for average 2020 and 2021 mortality relative to the average between 2016 and 
2019, but we additionally included an interaction term between this variable and the 
month variable simultaneously with the interaction term between vaccination uptake and 
the month variable (Table 3, Model 3). Despite this — in our opinion, conservative test — 
we still observed a significant association between 2021 vaccination uptake and the 2022 
monthly increase in all-cause mortality. Nonetheless, future research should extend the 
time frame beyond 2022’s first nine months to assess whether the relatively high all-cause 
mortality persists in countries with high vaccination uptakes. If so, there is even more 
reason to assume that there is a genuine association between 2021 COVID-19 vaccination 
uptake and 2022 excess mortality. Secondly, we controlled for 2019 pre-COVID life expec- 
tancy. The variable correlated positively with vaccination uptake and negatively with the 
other control variable — average 2020 and 2021 mortality relative to the 2016-2019 average 
mortality (Table 2). Accordingly, the inclusion of pre-COVID life expectancy as a control 
variable partakes to rule out other potential alternative explanations of our findings. Also, 
we included an interaction term between this variable and the month variable simultane- 
ously with the interaction term between vaccination uptake and the month variable, but 
without altering any statistical conclusion (Table 3, Model 4). Finally, we carried out un- 
reported analyses controlling for 2018 nation-level median age and 2019 per-capita GDP 
adjusted for purchasing power, respectively, as done in Models 3 and 4 (Table 3), but 
without altering any statistical conclusion (analyses are available upon request). 

Concerning ecological fallacy (3), we are cautious about making individual-level in- 
ferences from our nation-level findings. In other words, we emphasize that our study 
shows a positive association between 2021 nation-level vaccination uptake and 2022 nation- 
level monthly increase in excess mortality while ruling out reverse causality and account- 
ing for alternative explanations. Having said that, it may be worth discussing ecological 
fallacy in general and the plausibility of making individual-level inferences from our na- 
tion-level findings, which we do in the following paragraphs. 

Firstly, we address the classical Robinson’s paradox (25). At a US state level, Robin- 
son found that the illiteracy rate was lower the higher the foreign-born population rate, 
but at an individual level, foreign-borns had a higher probability of being illiterate than 
national-borns. An explanation of the paradox is that foreign-borns had a high proclivity 
to settle in states with high literacy rates, which illustrates a reverse causality. Returning 
to our study, we have argued that reverse causality is not a potential challenge to the 
results’ interpretation as the timing of the independent variable precedes the dependent 
variable. 

Secondly, we address the Simpson’s paradox (26, 27), which could imply that indi- 
vidual-level vaccination was associated with a monthly decrease in the individual-level 
mortality probability despite a positive association between the nation-level vaccination 
uptake and increased monthly mortality. However, Simpson’s paradox hinges on the 
omitted variable bias (28), or cross-level bias, which is the “difference between the expec- 
tation of an estimator from an ecological [group-level] study and the individual-level pa- 
rameter of interest” (29, p. 2). E.g., the mortality may have increased in a high-vaccinated 
country, not because vaccination is detrimental to health, but because relatively few peo- 
ple died there in the previous two years. Similarly, the mortality may have decreased ina 
low-vaccinated country, not because of a lower health risk than in high-vaccinated coun- 
tries, but because relatively many people died there in the two previous years. Related to 
this argument, it is relevant to address that there, for some countries, in concert with rel- 
atively low mortality in the pandemic’s two years, was a mortality increase early in 2022, 
arguably due to the COVID-19 omicron variant (e.g., 30). However, again, we emphasize 
having accounted for this issue by controlling for the 2020-2021 mortality (plus including 
other control variables, as discussed above). Also, we have shown that the mortality par- 
ticularly increased during the first nine months of 2022 in high-vaccination countries, 
while the mortality due to omicron abated early the same year (31). 


Finally, we emphasize that individual-level studies, too, can be subject to fallacy (29, 
32). E.g., collective vaccination status can be genuinely associated with reduced disease 
transmission. Accordingly, individual-level studies can be limited in capturing the asso- 
ciation between collective vaccination status and health outcomes. In light of this argu- 
ment, Loney and Nagelkerke (29, p. 2) assert that “even when the emphasis is clearly on 
the individual, with the ultimate objective of understanding the aetiology of disease, eco- 
logical [group-level] analyses can be more ‘truthful’ than individualistic analyses and may 
avoid a large portion of confounding on the individual level.” Subramanian, Jones (32, p. 
342) similarly state that “meaningful analysis of individual-level relationships requires 
attention to substantial heterogeneity in state [or group-level] characteristics. The impli- 
cation is that perils are posed by not only ecological fallacy but also individualistic fal- 
lacy.” To illustrate their point, they showed that the individual-level association between 
race and illiteracy in the US was biased in the absence of controlling for state-level heter- 
ogeneity. Hence, not only group-level studies but also individual-level ones can be subject 
to fallacy. Returning to our data, we accordingly acknowledge as a limitation that the as- 
sociation between nation-level vaccination uptake and excess mortality may not have 
fully captured an individual-level association, but at the same time an individual-level 
association could also have been biased in the absence of controlling for higher-level het- 
erogeneity (cf. 32). Therefore, we encourage future studies to address both levels simulta- 
neously. 

Other explanations of excess mortality than those studied in this paper can be de- 
layed diagnosis or medical treatment during COVID-19, although we cannot see that the 
issues have been more prevalent in high-vaccination vs. low-vaccination countries. Le., 
we do not expect delayed diagnosis or medical treatment during COVID-19 to substan- 
tially have induced omitted variable bias. Nonetheless, we encourage future studies to 
address the constructs as potential carrier of excess mortality, or eventually study them in 
concert with vaccination uptake. 

Moreover, future research should assess if all-cause mortality in different age cohorts 
or between genders is a function vaccination uptake or if the type of vaccination has 
played a role. Similarly, future research should investigate if vaccination uptake or type 
of vaccination is associated with specific causes of death. Data from England and Wales 
show excess mortality from April 2022 across gender and age cohorts and several diagno- 
ses (33). However, we do not know if the pattern can be attributed to vaccination uptake, 
type of vaccination, delayed diagnosis, delayed medical treatment, or if long-COVID (34) 
has played a role, and future research should investigate these issues. 

(The Appendix, carrying out pre-2022 analyses, illuminates a negative association 
between vaccination uptake and 2021 mortality relative to the 2016-2019 average mortal- 
ity, which indicates a short-time preventive effect. However, the association becomes non- 
significant when including relevant controls. 2019 life expectancy, on the other hand, has 
a significant negative association with 2021 mortality. Finally, the association between 
2019 life expectancy and vaccination uptake is strongly positive.) 


Appendix 

Table Al reports pre-2022 descriptive statistics and correlations weighted by coun- 
tries’ population size. In addition to the pre-2022 country-level variables we already re- 
ported on, it includes a variable measuring 2021 all-cause mortality relative to the 2016- 
2019 average mortality and one measuring 2020 all-cause mortality relative to the 2016- 
2019 average mortality. 


Table A1. Pre-2022 country-level descriptive statistics and correlations weighted by countries’ pop- 
ulation size. 


Min. Max. Mean St. dev. 1 2 3 4 
1011 1374 1133 3.49 2021 mort. rel. led avg. 

2020 mort. rel. to 2016-2019 avg. 
ge i207 ims so “more : Drees: 851% 
wa ger qus Bag “VE 2020-2021 mort detoa aogas yyy 

2019 (3) 

751 843 815 247 Life expectancy in 2019 (4) -0.845*** 0.029 -0.620°** 
77 Gi ear. may ma p by the end of geass -0.211 -0.742***  0.857%** 


Two-tailed tests of significance. t p < 0.10; * p < 0.05; ** p < 0.01; *** p < 0.001. N=31. 


We observe a strong negative correlation between vaccination uptake and 2021 mor- 
tality, which may indicate a preventive effect that year. Also, we observe a strong positive 
correlation between pre-COVID life expectancy and 2021 mortality, which may indicate 
an alternative or complementary explanation to the potential vaccine effect. Finally, we 
observe a strong positive correlation between pre-COVID life expectancy and vaccination 
uptake. 

Table A2 regresses 2021 mortality on vaccination uptake and pre-COVID life expec- 
tancy. Also, it includes 2020 mortality (compared to the 2016-2019 average) as a control 
variable. The regression aims to assess whether vaccination uptake and pre-COVID life 
expectancy is genuinely associated with 2021 mortality. The model shows that both inde- 
pendent variables have negative associations with the dependent variable, but only the 
pre-COVID life expectancy association is significant. The non-significant association be- 
tween vaccination uptake and 2021 mortality is in line with the largely non-significant 
direct association between vaccination and 2022 mortality (Table 3). However, high VIFs 
concerning the independent variables may indicate multicollinearity problems, particu- 
larly since the model has only 31 country observations (22). Altogether, we conclude that 
vaccination uptake may have temporarily reduced mortality in 2021 (but not in 2022, 
where the monthly mortality increases the higher the vaccination uptake, as shown earlier 
in the study). 


Table A2. Pre-2022 country-level linear weighted regressions with robust standard errors and 2021 
all-cause mortality compared to the 2016-2019 average as a dependent variable. 


Coeff. Beta 
Intercept 248.5%** 
(29.6) 
2020 mort. comp. to the 2016-2019 avg. 0.481** 0.295 
(0.152) 
[ 1.27] 
Life expectancy in 2019 -2.14** -0.633 
(0.552) 
[4.55] 
Vaccination uptake by the end of 2021 -0.209 -0.257 
(0.149) 
[4.76] 
R-square/R-square adj. 0.854/0.837 
F-value 39o 
Two-tailed N=31. Estimates are weighted by country size in population size by January 1, 2020, and 
we report robust standard errors in parentheses. We report variance inflation factors (VIFs) in brack- 
ets and beta values in the left column. 
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